Method and system for inserting comfort signal in reaction to events

ABSTRACT

During communication over the network, periods of silence may exist. The system may enable a user at a user terminal to determine one or more events that trigger the addition of a comfort signal. The system may monitor packet transmission to isolate the one or more events. The system may selectively add the comfort signal to the transmission in reaction to the triggering of the one or more events. The comfort signal may be added during periods of silence, as background noise, or during periods of silence and as background noise.

BACKGROUND INFORMATION

A wide variety of means exist for communication between users. Forexample, a user may conduct phone calls via their home phone, workphone, and mobile phone. In addition, a user may also communicate viathe Internet and other peer-to-peer models.

As technology improves, the performance of the communication networkimproves. Unfortunately, significant improvement in performance maycause user perception of system malfunctioning or a lack of functioning.For example, if the system is underutilized due to a long pause from aspeaker, if there are impairments in the channels, or if there arerecoverable or short duration faults in the network, communicationbetween users may include long durations of intermittent silence duringa conversation. During these periods of silence, the user may not beable to determine if the communication network is still functioning.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a block diagram of an exemplary system environmentfor implementing exemplary embodiments;

FIG. 2 illustrates a block diagram of an exemplary computerized systemenvironment for a network terminal, consistent with an exemplaryembodiment;

FIG. 3 illustrates a block diagram of an exemplary comfort center,consistent with an exemplary embodiment; and

FIG. 4 illustrates an exemplary time flow of a video messaging process,consistent with an exemplary embodiment.

DETAILED DESCRIPTION

Reference will now be made in detail to exemplary embodiments, examplesof which are illustrated in the accompanying drawings. The followingdescription refers to the accompanying drawings in which the samenumbers in different drawings represent similar elements unlessotherwise represented. The implementations set forth in the followingdescription of exemplary embodiments consistent with the presentinvention do not represent all implementations consistent with theclaimed invention. Instead, they are merely examples of systems andmethods consistent with aspects related to the invention as recited inthe appended claims.

Methods and systems implementing exemplary embodiments described hereinprovide a comfort signal. A comfort signal is anything that ispreferable to silence. Examples of a comfort signal can be noise, tone,music generation, etc. During communication over the network, periods ofsilence may exist. The system may enable a user at a user terminal todetermine one or more events that trigger the addition of a comfortsignal. The system may monitor packet transmission to isolate the one ormore events. The system may selectively add the comfort signal to thetransmission in reaction to the triggering of the one or more events.The comfort signal may be added during periods of silence, as backgroundnoise, or during periods of silence and as background noise.

FIG. 1 is a block diagram of a data processing and telecommunicationsenvironment, in accordance with methods and systems consistent with theprinciples of the present invention. The data processing andtelecommunications environment 100 may include a network 110 and one ormore user terminals 120, 130, 140, and 150. The one or more terminalsmay be implemented using voice-over Internet Protocol (“VoIP”)technology 120 or a peer-to-peer model, such as Skype 130. The one ormore terminals may also be implemented using a wireline phone 140 or amobile phone 150 to interface with network 110. Although phones 140 and150 are shown directly connected to network 110, any number ofintervening elements, such as a Private Branch Exchange (“PBX”), may beinterposed between phones 140 and 150.

Network 110 may be one or more communication networks that communicateinformation between network terminals 120, 130, 140, and 150. Network110 may be any type of network for communicating information, includingdata, text, pictures, and video. Network 110 may be a shared, public,private, client-server, or peer-to-peer network encompassing a wide orlocal area including an extranet, an Intranet, the Internet, a localarea network (LAN), wide area network (WAN), the public switchedtelephone network (PSTN), integrated services digital network (ISDN),radio links, wireless telephone and/or data network, and any other formof wired or wireless communication networks. Network 110 may becompatible with any type of communication protocol used by thecomponents of the system environment to exchange information, such asEthernet, ATM, SONET, Transmission Control/Internet Protocol (TCP/IP),Hypertext Transfer Protocol (HTTP), Wireless Application Protocol (WAP),the various wireless communication protocols (e.g., GSM, CDMA, EV-DO),or a peer-to-peer protocol. The network provider may be, for instance,an Internet Service Provider (ISP), a wired and/or wireless telephoneservice provider, a cable television provider, a satellite televisionprovider, a WAN operator, a LAN operator, or an operator of adirect-link/person-to-person network. In addition, network 110 may beimplemented using both PSTN and VoIP technology consistent with theprinciples of the present invention.

Telecommunications environment 100 may also include comfort center 300,depicted in FIG. 3. Comfort center 300 may provide a platform formanaging the addition of a comfort signal over network 110. Comfortcenter 300 may be implemented using a combination of hardware, software,and/or firmware. For example, comfort center 300 may be implementedusing a plurality of general purpose computers or servers coupled by anetwork (not shown). Comfort center 300 may be located, for example, onone or more of user terminals 120, 130, 140, and 150, and may also belocated within the network 110.

User terminals 120, 130, 140, and 150 may be configured to communicatewith comfort center 300. For example, a client application may beinstalled on user terminals 120, 130, 140, and 150, which directlycommunicates with comfort center 300. Also, user terminals 120, 130,140, and 150 may communicate with comfort center 300 via a proxy. Userterminals 120, 130, 140, and 150 may use aspects of TCP/IP including thehypertext transfer protocol (“HTTP”), the user datagram protocol(“UDP”), the file transfer protocol (“FTP”), the hypertext markuplanguage (“HTML”), and the extensible markup language (“XML”).

FIG. 2 is a block diagram exemplifying aspects of user terminals 120,130, 140, and 150. The exemplary user terminal 200 illustrated in FIG. 2may include controller 210, input device 220, and output device 230.Controller 210 may be one or more processing devices that executecomputer instructions and data stored in one or more memory devices.Controller 210 may include, for example, central processing unit (CPU)212 and memory unit 214.

Input device 220 provides the input to CPU 212. Input device 220 mayinclude, for example, a keyboard, a microphone, and a mouse. Other typesof input devices may also be implemented consistent with the principlesof the present invention.

Output device 230 may include, for example, a display, a printer, and aspeaker. Other types of output devices may also be implementedconsistent with the principles of the present invention.

CPU 212 may be any controller such as an off-the-shelf microprocessor(e.g., INTEL PENTIUM) or an application-specific integrated circuit(“ASIC”) specifically adapted for user terminal 200. Memory unit 214 maybe one or more memory devices that store data and computer instructionsthat, when executed by CPU 212, cause the terminal 200 to perform themethods described herein. Memory unit 214 may be embodied with a varietyof components of subsystems, including a random access memory (“RAM”)and a read-only memory (“ROM”).

If comfort center 300 is located within network 110, a network interface(not shown) provides a communications interface between user terminals120, 130, 140, and 150 and comfort center 300. The network interface mayreceive and transmit communications from user terminals 120, 130, 140,and 150. For example, the network interface may be a modem, or a localarea network (“LAN”) port.

During communication, voice is transmitted as packets of bytes. Thesepackets may be transmitted via RTP (IETF RFC 1889) streams. When novoice is present during a communication, there is a silence or packetswithout the sound of voices. During the transmission of packets overnetwork 110, delays in transmission may occur based on, for example, thetraffic load. In addition, jitters, packet strength loss, and signalstrength loss may also occur based on the transmission characteristicsof the packets. If events, including, for example, a delay exceeding athreshold value, a jitter, or packet and signal strength loss thatexceed predetermined parameters, are detected by the user terminal 120,130, 140, and 150, the user terminal select a type of comfort signal tobe added in reaction to these events.

Comfort center 300 may present the user with a list of comfort signalchoices that the user terminal may select. Comfort center 300 may alsoreceive a user input comfort signal from user terminals 120, 130, 140,and 150 via input device 220. The user may communicate with the comfortservice to add white (i.e. Gaussian) noise or colored noise during theseperiods. This comfort signal may have frequencies within an audiblerange, which may be between approximately 330 Hz and 3.4 KHz, that mayvary periodically in amplitude. This comfort signal may be added inreaction to triggering of events defined by the user. For example, if anend-to-end delay exceeds 400 msec, the silence packets may be replacedby the comfort signal.

The comfort signal fills the bytes and packets of silence. The comfortsignal may be generated using at least one byte of data. Each of the atleast one byte of data contains eight bits, which may specify the typeof comfort signal to be added (i.e. the color). By using at least onebyte, the user may be presented with many types of comfort signals. Ifthe user has selected a type of comfort signal to be added, userterminals 120, 130, 140, and 150 may monitor the packet transmission atthe endpoint and selectively add the comfort signal in reaction to thetriggering of events defined by the user.

The configuration or relationship of components illustrated in FIGS. 1and 2 is exemplary. For example, input device 220 and output device 230may be a plurality of independent devices within separate housingsdetachably connected to a generic controller, such as a personalcomputer or set-top box. In other implementations, controller 210, inputdevice 220, and output device 230 may be integrated within a singlehousing such as a mobile telephone. One of ordinary skill in the art mayselect different configurations of components based on the requirementsof a particular implementation of a user terminal giving considerationto factors including, but not limited to, cost, size, speed, formfactor, capacity, portability, power consumption and reliability.

FIG. 3 is a block diagram exemplifying aspects of comfort center 300.Comfort center 300 may be located, for example, on one or more of userterminals 120, 130, 140, and 150, and may also be located within thenetwork 110.

Comfort center 300 may include controller 310. Controller 310 may be oneor more processing devices that execute computer instructions and datastored in one or more memory devices. Controller 310 may include, forexample, CPU 320 and memory units 330 and 340. CPU 320 that may be anycontroller such as an off-the-shelf microprocessor (e.g., INTEL PENTIUM)or an application-specific integrated circuit (“ASIC”) specificallyadapted for comfort center 300.

Memory units 330 and 340 may be embodied with a variety of components ofsubsystems, including a random access memory (“RAM”) and a read-onlymemory (“ROM”). Memory unit 330 may contain a database of comfort signaloptions that may be presented to the user terminals 120, 130, 140, and150. User terminals 120, 130, 140, and 150 may select a type of comfortsignal from the database. User terminals 120, 130, 140, and 150 may alsoinput a desired comfort signal that is not part of the database ofcomfort signal options. If the user inputs a desired comfort signal thatis not part of the database, memory unit 340 may store the user inputcomfort signal.

Once memory units 330 and 340 store the desired comfort signal from userterminals 120, 130, 140, and 150, CPU 320 may also monitor the packettransmission characteristics and selectively add the desired comfortsignal in reaction to, for example, delays in transmission, jitters,packet strength loss, and signal strength loss may also occur based onthe transmission characteristics of the packets. The comfort signal maybe played during periods of silence, in the background, or during bothperiods of silence and in the background. In other implementations,memory units 330 and 340 may be integrated within a single memory unit.One of ordinary skill in the art may select different configurations ofcomponents based on the requirements of a particular implementation of auser terminal giving consideration to factors including, but not limitedto, cost, size, speed, form factor, capacity, portability, powerconsumption and reliability.

FIG. 4 contains a sequence diagram exemplifying the interaction of userswith the exemplary systems and methods described herein. At step 410, auser may activate a silence suppression at the user terminal (i.e.terminals 120, 130, 140, and 150) to suppress information packetsduring, for example, periods of silence. If the user has decided toactivate a silence suppression during communication, user terminals 120,130, 140, and 150 may communicate with the comfort center. The comfortcenter may present the user with a list of comfort signal choices thatthe user terminal may select. The comfort center may also receive adesired comfort signal from user terminals 120, 130, 140, and 150 viainput device 220. The comfort signal may be white or colored noise andmay have frequencies within an audible range, which may be betweenapproximately 330 Hz and 3.4 KHz, that may vary periodically inamplitude.

Once the user has determined the type of comfort signal to be added, theuser may also determine one or more events that may trigger the additionof the comfort signal at step 420. These events may include, forexample, delays in information transmission exceeding a threshold value,jitters, or packet and signal strength loss that exceed predeterminedparameters.

Once the user terminal 120, 130, 140, and 150 activates a silencesuppression and determines the triggering events that may generate theaddition of the comfort signal, the user may select when the comfortsignal should be added at step 430. Once the user selects when thecomfort signal should be added, the user terminal 120, 130, 140, and 150and comfort center 300 may monitor the packet transmission andselectively add the comfort signal in reaction to the triggering ofevents defined by the user at step 440.

Other embodiments of the invention will be apparent to those skilled inthe art from consideration of the specification and practice of theinvention disclosed herein. For example, comfort signal generation maybe used in any electromechanical apparatus to indicate that certainactions are occurring (i.e. opening a window or putting a vehicle inreverse). It is intended that the specification and examples beconsidered as exemplary only, with a true scope and spirit of theinvention being indicated by the following claims.

1. A method comprising: receiving, from a user, a selection of a desiredcomfort signal or a user input of a desired comfort signal; determiningone or more events that trigger the addition of the desired comfortsignal; monitoring packet transmission to isolate the one or moreevents; and selectively adding the desired comfort signal to thetransmission in reaction to triggering of the one or more events.
 2. Themethod of claim 1, wherein the desired comfort signal is one of noise,tone, or music.
 3. The method of claim 1, wherein monitoring occurs atan endpoint of the transmission.
 4. The method of claim 1, wherein theinformation packets are transmitted via RTP streams.
 5. The method ofclaim 1, wherein the desired comfort signal is white noise.
 6. Themethod of claim 1, wherein the desired comfort signal is colored noise.7. The method of claim 1, wherein the desired comfort signal has afrequency between approximately 330 Hz and 3.4KHz.
 8. The method ofclaim 1, wherein a color of the desired comfort signal is specified byat least one byte of information.
 9. The method of claim 1, wherein theone or more events include exceeding a threshold value of a monitoreddelay, a jitter, or packet and signal strength loss that exceedpredetermined parameters.
 10. The method of claim 1, wherein the desiredcomfort signal is added during periods of silence, as background noise,or during periods of silence and as background noise.
 11. A systemcomprising: a network providing telephony services; a calling device,coupled to the network, configured to interface a user with the network;and a comfort center coupled to either the calling device or thenetwork, wherein the comfort center and calling device enable the userto: determine a desired comfort signal selected by the user or input bythe user; determine one or more events that trigger the addition of acomfort signal, monitor packet transmission to isolate the one or moreevents, and selectively add the comfort signal to the transmission inreaction to triggering of the one or more events.
 12. The system ofclaim 11, wherein the desired comfort signal is one of noise, tone, ormusic.
 13. The system of claim 11, wherein monitoring occurs at anendpoint of the transmission.
 14. The system of claim 11, wherein theinformation packets are transmitted via RTP streams.
 15. The system ofclaim 11, wherein the desired comfort signal is white noise.
 16. Thesystem of claim 11, wherein the desired comfort signal is colored noise.17. The system of claim 11, wherein the desired comfort signal has afrequency between approximately 330 Hz and 3.4 KHz.
 18. The method ofclaim 11, wherein a color of the desired comfort signal is specified byat least one byte of information.
 19. The system of claim 11, whereinthe network is operable to perform Voice over Internet Protocol (VoIP).20. The system of claim 11, wherein the one or more event includeexceeding a threshold value of a monitored delay, a jitter, or packetand signal strength loss that exceed predetermined parameters.
 21. Thesystem of claim 11, wherein the desired comfort signal is added duringperiods of silence, as background noise, or during periods of silenceand as background noise.